
REMARKS 

The present application was filed on October 6, 2000 with claims 1-20. 
Claims 1-20 are currently pending in the application. Claims 1 5 10, 19 and 20 are the 
independent claims. 

Applicants again note that the present application claims the priority of U.S. provisional 
application Serial No. 60/165,802 filed November 16, 1999, although the Examiner has failed to 
provide an appropriate acknowledgment of this domestic priority claim in any of the Office Actions 
issued to date. The priority claim is properly acknowledged in the updated filing receipt dated April 
5,2001. 

In the final Office Action, claims 1-18 and 20 stand rejected under U.S.C. § 102(e) as being 
anticipated by U.S. Patent No. 6,0 1 4,694 (hereinafter "Aharoni"), and claim 1 9 stands rejected under 
U.S.C. §103(a) as being unpatentable over Aharoni in viewofU.S. PatentNo. 6,460,153 (hereinafter 
"Chou"). 

In this response, Applicants traverse the § 102(e) and § 103(a) rejections, and amend 
independent claims 1 , 1 0, 1 9 and 20. Applicants respectfully request reconsideration of the present 
application in view of the above amendments and the following remarks. 

With regard to the § 102(e) rejection, Applicants note that the Manual of Patent Examining 
Procedure (MPEP), Eight Edition, August 2001, §2131, specifies that a given claim is anticipated 
"only if each and every element as set forth in the claim is found, either expressly or inherently 
described, in a single prior art reference," citing Verdegaal Bros, v. Union Oil Co. of California , 8 14 
F.2d 628, 631, 2 USPQ2d 1051, 1053 (Fed. Cir. 1987). Moreover, MPEP §2131 indicates that the 
cited reference must show the "identical invention ... in as complete detail as is contained in the 
. . . claim," citing Richardson v. Suzuki Motor Co. . 868 F.2d 1226, 1236, 9 USPQ2d 1913, 1920 
(Fed. Cir. 1989). 

For the reasons identified below, Applicants submit that the Examiner has failed to establish 
anticipation of at least independent claims 1, 10, 19 and 20, as originally filed, by the Aharoni 
reference. 

The present invention as set forth in claim 1 as originally filed is directed to a method of 
processing a video signal for transmission over a heterogeneous network. The method includes steps 
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which recite coding the video signal in a progressive video coder, transmitting the progressive coded 
video bit stream over a first part of the heterogeneous network at a first bit rate, and selectively 
transmitting one or more portions of the progressive coded video bit stream from the first part of the 
heterogenous network to a second part of the heterogenous network. The coding step further 
specifies that the progressive coded video bit stream is configured to be decodable at any one of a 
series of increasing bit rates up to a maximum bit rate, depending on which of a number of 
corresponding portions of the progressive coded video bit stream are received by a decoder, and that 
each of the series of increasing bit rates produces progressively better reconstructed video quality 
at an output of the decoder. The selectively transmitting step further specifies that the one or more 
portions are associated with a second one of the bit rates lower than the first bit rate, with the 
particular portions and the second bit rate being selected based at least in part on one or more of: (i) 
an error detected in the transmission over the first part of the heterogeneous network; and (ii) a 
characteristic of the second part of the heterogeneous network. 

An illustrative example of a progressive coded video bit stream of a type falling within the 
above-described limitations of claim 1 is shown in FIG. 3 of the drawings, and is described as 
follows in the specification at page 10, lines 13-19: 

FIG. 3 shows a progressive coded video bit stream 300 generated by progressive 
video coder 1 1 0 from a given group of frames 3 1 0. The group of frames may represent, e.g., 
a group of pictures (GOP) as the term is used in conventional video coding standards, or any 
other type of video signal or image sequence. The bit stream 300 may be viewed as 
including a number of different portions, with a maximum target bit rate of 384 kbps 
achieved when all portions are received, and intermediate bit rates of 64 kbps, 128 kbps and 
256 kbps being achieved if only first, second or third portions, respectively, are received. 

The progressive coded video bit stream 300 in this example thus includes four distinct portions, as 
illustrated in the figure, with each of the portions corresponding generally to a different bit rate 
achievable upon receipt of that portion and any preceding portions in a decoder. 
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In the final Office Action, at page 3, first paragraph, the Examiner mischaracterizes the 
foregoing description of an example progressive coded video bit stream 300 as an "admitted 
definition." Applicants wish to point out that the description in question is explicitly characterized 
as being "[a]n illustrative example of a progressive coded video bit stream of a type falling within 
the above-described limitations of claim 1." Thus, it is improper for the Examiner to attempt to 
characterize the illustrative example as an admitted definition of any claim term. It is merely one 
example of an arrangement that falls within the claim limitations, and is not intended to serve as a 
definition of any of the limitations. x 

In formulating the § 102(e) rejection, the Examiner argues that each and every limitation of 
claim 1 as described above is disclosed in the Aharoni reference. Applicants respectfully disagree. 
As indicated above, the present invention as set forth in claim 1 specifically calls for coding a video 
signal in a progressive video coder so as to generate a progressive coded video bit stream configured 
to be decodable at any one of a series of increasing bit rates up to a maximum bit rate , depending on 
which of a number of corresponding portions of the progressive coded video bit stream are received 
by a decoder. Applicants note that the Aharoni reference makes no explicit reference to progressive 
video coding. 

In their previous response, Applicants indicated that the word "progressive" apparently does 
not appear anywhere in the Aharoni reference. The Examiner in the final Office Action at page 2, 
last two lines, to page 3, line 1 , counters that the term "scaleable compression" as recited in Aharoni 
is anticipatory of the claimed progressive coding. However, the scaleable compression as recited 
in Aharoni is not progressive coding of the type claimed, but is instead layered video coding of a type 
similar to that described by Applicants in the background section of their specification, at page 1, 
line 30 to page 2, line 8, as follows: 

Other known video bit stream adaptation techniques have focused primarily on 
scalability of the video bit stream to different bandwidth conditions. For example, layered 
video coders have been developed which generate video bit streams consisting of several 
layers, usually a base layer followed by one or more enhancement layers, as described in S. 
McCanne, "Scalable Compression and Transmission of Internet Multicast Video," Ph.D. 
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Thesis, University of California Berkeley, December 1996. The layered video coder allows 
users with greater bandwidth capability to subscribe to more layers, and thereby receive 
better video quality, while users with less bandwidth capability can subscribe to the base 
layer only. This provides adaptive video quality for different users while minimizing the 
bandwidth inefficiency associated with transmission of the video at several different bit rates. 

Thus, it appears that Aharoni discloses nothing more than a type of conventional layered video 
coding, and not the particular progressive video coding arrangement set forth in claim 1 as originally 
filed. 

Accordingly, since Aharoni fails to teach or suggest "each and every element" of independent 
claim 1 in "as complete detail as is contained in the . . . claim," as required by MPEP §2131 for a 
proper anticipation rejection, claim 1 is not anticipated by Aharoni. 

Independent claims 10, 19 and 20 as originally filed include limitations similar to those of 
claim 1, and are believed allowable for substantially the same reasons identified above with regard 
to claim 1 . 

Dependent claims 2-9 and 1 1-18 are believed allowable for at least the reasons identified 
above with regard to their respective independent claims. Moreover, certain of these claims are 
believed to define additional separately-patentable subject matter over Aharoni and the other art of 
record. 

With regard to the § 1 03(a) rejection over Aharoni and Chou, Applicants submit that the Chou 
reference fails to overcome the fundamental deficiency of the Aharoni reference as applied to 
independent claim 1. The § 103(a) rejection is therefore believed to be improper and should be 
withdrawn. 

Notwithstanding the foregoing traversal, Applicants have amended independent claims 1,10, 
1 9 and 20 to clarify the progressive video coding aspects of the present invention. More specifically, 
each of these claims has been amended to specify that the portions of the progressive coded video 
bit stream are arranged within the progressive coded video bit stream in a predetermined sequence 
of increasing bit rates, from an initial portion associated with a lowest one of the bit rates to a final 
portion associated with a highest one of the bit rates. Support for the amendment can be found 
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throughout the specification, for example, in the illustrative embodiments shown in FIGS. 2 and 3 
of the drawings, and in the corresponding text at page 6, line 19 to page 7, line 9 and page 10, lines 



In view of the traversal, Applicants submit that the amendments to claims 1, 10, 19 and 20 
are not made for reasons relating to patentability over Aharoni, Chou or any other art of record, but 
instead are made solely in order to expedite prosecution of the application. 

The amendments made herein are responsive to points first raised by the Examiner in the 
final Office Action, in the section at pages 2-3 thereof addressing the remarks made by Applicants 
in their previous response. Thus, the amendments should be entered in accordance with 37 C.F.R. 



In view of the above, Applicants believe that claims 1-20 as amended are in condition for 
allowance, and respectfully request the withdrawal of the § 102(e) and § 103(a) rejections. 



13-19. 



§1. 116(c). 



Respectfully submitted, 



Date: January 20, 2004 




Attorney for Applicant(s) 
Reg. No. 37,922 
Ryan, Mason & Lewis, LLP 
90 Forest Avenue 
Locust Valley, NY 11560 
(516) 759-7517 
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Anand 2-17-16 

METHOD AND APPARATUS FOR VIDEO TRANSMISSION OVER A 
HETEROGENEOUS NETWORK USING PROGRESSIVE VIDEO CODING 

Priority Claim 

The present application claims the benefit of U.S. Provisional Application No. 60/165,802, 
filed November 1 6, 1 999 and entitled "A Framework for Video Transmission Over a Heterogeneous 
Wired-to-Wireless Network." 



10 Related Application 

L o 1 v 

^SmJO^^-— ^ The present application is related to U. S . Patent ApplicatioiLA^ 

16-15 entitled "Method and Apparatusior-Prt5^ Error Protection for a Source Coded 

Bit Stream," filedj^neufrently herewith in the name of inventors R. Anand, H.-L. Lou and C. 
Podilchukfami incorporated by reference herein. 



j Field of the Invention 

j The present invention relates generally to information coding and transmission, and more 

particularly to transmission of progressive coded video over a heterogeneous network. 

i 20 Background of the Invention 

Id In conventional communication systems, a coded video bit stream may be transmitted^^ 

a heterogeneous wired-to-wireless network. For example, the coded videoJbit^!ream may be 
transmitted from a wired Internet connection to a wireless mobilej^c€iver. Due to differences in 
loss conditions and bandwidth constraints between the ytktffmd wireless portions of the network, 
it is common in such coded video bit streajn-trSnsmissions to partially or fully decode the coded 
video bit stream, reencode the yijietflft an appropriate rate, and then add error resiliency properties 
prior to transmission ta^h€wireless receiver. An example of a technique of this type is described 
in G. de \osR€yes et al., "Video Transmission For Resilience in Wireless Channels," IEEE 
International Conference on Image Processing," Chicago, IL, October 1998. 

Other known video bit stream adaptation techniques have focused primarily on scalability 
of the video bit stream to different bandwidth conditions. For example, layered video coders have 
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been developed which generate video bit streams consisting of several layers, usually a base layer 
followed by one or more enhancement layers, as described in S. McCanne, "Scalable Compression 
and Transmission of Internet Multicast Video," Ph.D. Thesis, University of California Berkeley, 
December 1996. The layered video coder allows users with greater bandwidth capability to 
5 subscribe to more layers, and thereby receive better video quality, while users with less bandwidth 
capability can subscribe to the base layer only. This provides adaptive video quality for different 
users while minimizing the bandwidth inefficiency associated with transmission of the video at 
several different bit rates. 

Current video coding standards such as MPEG-2 and H.263 also have layered coding 

10 profiles, with options of temporal, spatial, signal-to-noise ratio (SNR) and hybrid scalability. For 
example, the MPEG-2 standard describes a spatially-scalable profile which consists of two layers, 
a digital standard television resolution layer and an enhancement layer for high definition television. 
See, e.g., B. Haskell et al, "Digital Video: An Introduction to MPEG-2," Chapman and Hall, 1997. 
However, the scalability options for these current standards come at the expense of compression 

15 performance. These and other layered coders offer scalability on a coarse level in that each layer 
must be completely received in order to be utilized in enhancing the video quality. 

Transcoders have also been used to provide bit rate adaptability in applications such as the 
above-noted wired-to-wireless heterogeneous network. Conventional transcoding techniques 
generally focus on either bit rate conversion or conversion between standards, e.g., H.263 to H.261 

20 conversion. Since the current video coding standards generally have the same basic components, 
transcoders are designed to reuse as many of the components as possible. For example, it is highly 
desirable to reuse the motion vector estimates, since their generation is a computationally very 
expensive process. Other techniques have addressed the issue of reducing the overall bit rate, e.g., 
converting from a high bit rate studio format to a low bit rate distribution format, while utilizing as 

25 much of the original bit stream information as possible, e.g., the original motion vector estimates and 
coding mode choices. 

A significant problem with conventional transcoders is that decoding and recoding the video 
bit stream can adversely impact the resulting reconstructed video quality. In addition, the decoding 
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and recoding operations can introduce substantial additional delay as well as computational 
complexity in a video transmission system. 
3^ Known video transmission techniques for lossy channel conditions have focused on either^ 



adding error resilient features to well-defined coding standards such as H.263++ and MPE6-4, or 
on channel coding for either packet losses over Internet protocol (IP) connections or wkeless channel 
conditions. Examples of the former types of techniques are described in J. Wen-dt al., "A Class of 
Reversible Variable Length Codes For Robust Image and Video Coding," Proceedings of the IEEE 
International Conference on Image Processing, Santa Barbara, CA, Vok"2, pp. 65-68, October 1997; 
J. Villasenor et al., "Robust Video Coding Algorithms and Sy^t^ms," Proceedings of the IEEE, 
Special Issue on Wireless Video; andN. Farber et al., "Extensions of ITU-T Recommendation H.324 
For Error-Resilient Video Transmission," IEEE Communications Magazine, pp. 120-128, June 1998, 
while examples of the latter types of techniques are described in C. Leicher, "Hierarchical Encoding 
of MPEG Sequences Using Priority Encoding Transmission (PET)," Berkeley Technical Report TR- 
94-058, November 1994; B. Girod et al., "Packet Loss Resilient Internet Video Streaming," Visual 
Communications and Image Processing '99, SPIE, San Jose, CA, January 1999; A.E. Mohr et al., 
"Graceful Degradation Over Pajeket Erasure Channels Through Forward Error Correction," 
Proceedings of the 1999 Data Compression Conference (DCC), Snowbird, Utah; K.W. Stuhlmiiller 
et al., "Scalable Internet Video Streaming With Unequal Error Protection," Packet Video Workshop, 
New York, April 1999^R. Puri et al, "Multiple Description Source Coding Using Forward Error 
Correction (FEC) Codes," 33 rd ASILOMAR Conference on Signals, Systems, and Computers, 
Pacific Grove^/CA, 1999; B. Girod et al., "Feedback-Based Error Control for Mobile Video 
Transmissipif," Proceedings of the IEEE, Special Issue on Video For Mobile Multimedia, accepted 
for publication, October 1999; and P.G. Sherwood et al., "Error Protection For Progressive Image 
Transmission Over Memoryless and Fading Channels," IEEE Transactions on Communications, 
Vol 46, No. 12, December 1998. 

( Unfortunately, the above-noted conventional techniques have been unable to provide an 
efficient general framework for video transmission over a heterogeneous network, which allows bit 
rate scalability, adaptability across different network conditions, and graceful degradation in the 
presence of channel errors. A need therefore exists in the art for such a framework. 
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Summary of the Invention 

\^ The present invention provides methods and apparatus for video transmission over J 
heterogeneous network which meet the above-described need by generating a progressive goded 
video bit stream configured so as to be decodable at any one of a series of increasing Jjk'fates up to 
5 a maximum bit rate, depending on which of a number of corresponding portiops^f the progressive 
coded video bit stream are received by a decoder. Each of the portions is^ssociated with a different 
bit rate, and one or more of the portions may each also be assc^r^tedwith different values of other 
coding-related parameters such as frame rate, spatial resolution, and peak signal-to-noise ratio. Each 
of the series of increasing bit rates produces progressively better reconstructed video signal quality 
10 at an output of the decoder. The progressive coded bit stream is transmitted over a first part of a 
heterogeneous network at a firsfone of the bit rates. One or more selected portions of the 
progressive coded video>it stream are then transmitted from the first part of the heterogeneous 
network to a second^art of the heterogeneous network. The selected portions are associated with 
a second one oflthe bit rates lower than the first bit rate, and may be selected based an error detected 
15 in the traiismission over the first part of the heterogeneous network, a characteristic of the second 
pa^fof the heterogeneous network, or combinations of these and other factors. 

Advantageously, the present invention provides efficient bit rate scalability and adaptability 
and is particularly well-suited for use in conjunction with transmission over heterogeneous wired-to- 
wireless networks. For example, the present invention allows bit rate scalability and adaptation 
20 across a wired-to-wireless network without incurring the substantial additional delay and 
computational complexity usually associated with a conventional transcoder. 



Brief Description of the Drawings 

FIG. 1 shows a simplified block diagram of one type of communication system in which the 
25 present invention may be implemented. 

FIGS. 2 and 3 show examples of progressive video bit streams generated in accordance with 
the techniques of the present invention. 

FIG. 4 shows a wired-to-wireless implementation of the system of FIG. 1 in which the 
present invention may be implemented. 
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FIG. 5 illustrates the processing of a progressive video bit stream generated in accordance 
with the present invention in the wired-to-wireless system of FIG. 4. 

Detailed Description of the Invention 

5 The following description will illustrate the invention using exemplary communication 

systems. It should be understood, however, that the invention is more generally applicable to any 
communication system or video transmission application which can benefit from video transmission 
with efficient bit rate scalability and adaptability. Although particularly well-suited for use in 
conjunction with fully-embedded progressive coded video bit streams, the techniques of the 
1 0 invention are also applicable to other types of coded video bit streams, such as partitioned video bit 
streams. The term "progressive coded video bit stream" as used herein should be understood to 
jjj include such other types of coded video bit streams. 

n FIG. 1 shows a simplified block diagram of an example communication system 1 00 in which 

t the present invention may be implemented. The system 1 00 includes a transmitter 1 02 and a receiver 

^15 104 configured to communicate over a transmission medium 106. The transmission medium 106 
3 may represent a portion of a wired or wireless network, combinations of different portions of such 

^ networks, or any other type of communication channel(s). The transmitter 102 includes a 

3 progressive video coder 1 1 0 and a channel coder 112. The receiver 1 04 includes a channel decoder 

R 114 and a video decoder 116. The video decoder 1 1 6 is a type of video decoder capable of decoding 

i 20 a progressive video bit stream of the type generated by coder 110. 

<^^0^^^ In operation, a source video signal is applied to the progressive video coder 1 1 (XJQie^etrfce" 
video signal may comprise, e.g., a sequence of frames. The progressiveyjdee-t5o3er 110 generates 
a progressive coded video bit stream in a manner to b^desgnbed in greater detail below in 
conjunction with FIGS. 2 and 3. The progressivg^oded video bit stream is then applied to the 
25 channel coder 112, which applies ujieqtial error protection channel coding to the progressive source 
coded bit stream using th^itSgressive channel coding techniques described in the above-cited U.S. 
Patent ApplicaJierfAttorney Docket No. Anand 1-16-15. It should be noted, however, that other 
channgk?6ding techniques could also be used. 
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The output of the channel coder 112 may be further processed using conventional 
communication system operations such as modulation, multiplexing, upconversion, amplification, 
filtering, etc. These operations are omitted from the figure for simplicity and clarity of illustration. 
The resulting signal is passed over the transmission medium 106 and subject to complementary 
communication system operations in or prior to the receiver 104. The recovered channel coded bit 
stream is applied to channel decoder 114, and the resulting progressive coded video bit stream is 
decoded in video decoder 116 to obtain a reconstructed version of the original information bit 
stream. The channel coder 112 and channel decoder 1 14 are preferably a convolutional coder and 
decoder, respectively, although other types of channel coding could also be used. 

The present invention provides progressive coded video transmission techniques suitable for 
use in the system 100 of FIG. 1 or in other types of communication systems. In an illustrative 
embodiment of the invention, a progressive video coder generates a fully-embedded bit stream that 
can be decoded at any desired intermediate bit rate up to a maximum specified target bit rate, 
producing progressively better reconstructed video quality with increasing bit rate. Advantageously, 
the progressive video transmission techniques of the present invention are highly scalable in bit rate, 
and thereby allow adaptability to different bandwidth conditions over a heterogeneous network as 
well as a framework for introducing graceful degradation in video quality in the presence of bit 
errors and bandwidth constraints. 

FIG. 2 shows an example of a progressive coded video bit stream 200 generated in the 
progressive video coder 1 10. In this example, the bit stream 200 may be viewed as separated into 
five portions 210-1,210-2,210-3,210-4 and 2 10-5 as shown. The fully recovered bit stream results 
in the maximum bit rate denoted R(4) and a maximum peak signal-to-noise ratio (PSNR) denoted 
PSNR(4). The progressively-coded video data is prioritized from left to right within the bit stream 
200 so that with unequal error protection, as packet losses increase, the recovered video signal at the 
receiver scales back first in temporal resolution (frame rate), followed by spatial resolution (pixels 
per frame), followed by quantizer step size (PSNR and bit rate). 
V3_3^-^M° re particularly, the maximum tar get bit rate R(4), which is achieved when alLfive^oFtion^ 
of the bit stream200-arel : eceiv^, corresponds to a 30 frame per second (fps) video signal having 
a-Gff^esolution of 360x240 pixels. The bit stream 200 scales down from right to left in terms of 
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frame rate, from 30 fps if all five portions are received, to 15 fps if the first four are received, and 
subsequently to 10 fps if only the first three or fewer portions are received. Similarly, the bit stream 
scales down from right to left in resolution from the CIF resolution if at least the first three portions 
are received, to a quarter-CIF (QCIF) resolution of 180x120 pixels if only the first two or fewer 
5 portions are received. The bit stream 200 also scales downward from right to left in peak signal-to- 
noise ratio (PSNR), from a maximum value PSNR(4) through intermediate values PSNR(3), 
PSNR(2), PSNR(l) and PSNR(0) depending on the portions received, and in bit rate, from the 
above-noted maximum target bit rate R(4) through intermediate values R(3), R(2), R(l) and R(0), 
again depending on the portions received. 
^u? ^ =^-\, As mentioned previously, a fully-embedded progressive coded video bit steam suchas 

shown in FIG. 2 can be provided with unequal channel error protection in t^maiifiefdescribed in 
f the above-cited U.S. Patent Application Attorney Docket No^^andl^l 6- 1 5 . Such an arrangement 

n allows for efficient adaptation of the bit streamaprosS'fieterogeneous networks, with low complexity 

^ and optimum bandwidth utilizatio^Mdfeparticularly, a progressive coded video bit stream of the 

^15 type described above canirdutilized in the illustrative embodiment of the invention to provide direct 
5 bit rate ad^tabilityat the bit stream level, such that encoded video sequence can adapt to any bit rate 

^ ayaiKMe across a given heterogeneous wired-to-wireless network. 

3 In addition, the bit stream can be used to provide direct adaptability to packet losses or other 

n errors incurred during transmission over the wired portion of such a network. The embedded coding 

i 20 framework permits the determination of which part of the data to discard due to packet losses. The 
above-noted unequal error protection allows the high priority data to be provided with a higher level 
of protection than the low priority data, so that packet losses result in a drop in video quality 
equivalent to scaling back the embedded bit stream to a lower rate. Furthermore, the structure of the 
embedded sequence allows the bit stream to be scaled back in terms of frame rate, spatial resolution 
25 and PSNR. In other words, packet losses can result in lower frame rate, lower spatial resolution or 
lower PSNR, or combinations thereof, depending on the severity of the channel conditions. The 
scaling back is typically first done temporally, then spatially and finally in PSNR, but any order 
could be used, including multiple passes in any order. This is in contrast to a non-progressive bit 
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stream such as a conventional MPEG bit stream in which packet losses can result in visible block- 
like distortions that can propagate over many frames. 

The progressive coded video bit stream transmission techniques in accordance with the 
invention also provide efficient bandwidth utilization for wireless portions of a heterogeneous wired- 
5 to-wireless network. Because the video scales back in rate for channel losses incurred during 
transmission, one can determine exactly how much of the original video bit stream can be recovered 
and send only useful data over the bandwidth-constrained wireless link. This generally cannot be 
done for conventional MPEG and H.263 coders because motion estimation and inter- and intra- frame 
dependencies make it difficult to determine what data remains useful after packet losses. 
1 0 Another advantage of the progressive coded video bit stream transmission techniques of the 

present invention is that by sending only the useful video data over the wireless portion of a given 
? wired-to-wireless network connection, any remaining bandwidth can be used for additional physical 

j layer channel coding. A feedback channel could also be implemented so as to provide information 

] for adapting the source and channel coding bit rate allocation, such that the bit stream can be 

1 15 ap]>ropriately scaled in accordance with channel conditions. 

3\^U^O_3i_ l^The present invention can be implemented using a conventional progressive videocpdefT 
h For example, a so-called SPEHT coder may be used to implement the progressive'video coding 

: described above. Additional details regarding conventional SPIHT^pod^are described in, e.g., A. 

1 Said et al., "A New and Efficient Image Codec Based on-Set Partitioning in Hierarchical Trees," 

\ 20 IEEE Transactions on Circuits and Systems/orVideo Technology, June 1996; B.-J. Kim et al., 
"Very Low Bit-Rate Embedded Co£in|fwith 3D Set Partitioning in Hierarchical Trees," IEEE 
Transactions on Circuits an^S^stems for Video Technology, Special Issue on Image and Video 
Processing for Emerging Interactive Multimedia Services, Sept. 1998; and B.-J. Kim et al, 
"Low-Delay,Eifibedded Video Coding with SPIHT," Proc. SPIE, Visual Communications and Image 
25 Processing '98, pp. 955-964, Jan. 1998; all of which are incorporated by reference herein. 

^ In the illustrative embodiment of the present invention, a fully-embedded progressive bit 
stream is generated for a given group of frames of a video signal to be encoded. The above-noted 
SPIHT coder can be utilized to produce a bit stream that is PSNR scalable, since the location of a 
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next wavelet coefficient to be coded may be chosen to maximize a reduction in mean square error. 
The same bit stream can be reordered to produce a temporally or spatially scalable bit stream as well. 

As previously noted in conjunction with FIG. 2, a progressive video coder suitable for use 
in conjunction with the invention produces a bit stream having a well-defined priority. Experiments 
performed on such a bit stream indicate that at least about 20% of the bit stream generally must be 
received error free in order to produce a useful and observable output video signal. Thus, the initial 
20% of the bits of the bit stream require heavy error protection, depending on the channel condition 
and the delay allowed in the system. Furthermore, depending on the minimum decoded video 
quality to be guaranteed to each user, heavy error protection of more than 20% of the video bit 
stream may be required. For example, an automatic repeat request (ARQ) technique may be used 
for this portion of the bit stream, with decreasing levels of error protection for less important 
portions of the bit stream. The above-noted unequal error protection can be used to protect the rest 
of the bit stream since if the more important bits are not received error free, bits in the rest of the bit 
stream generally cannot improve the decoded signal quality. Due to the embedded nature of the bit 
stream, an erroneous decoded bit can result in loss of synchronization such that the remaining 
decoded bits only add to the error or noise in the decoded video stream. 

S^±-\ Although the channel error protection for the progressive bit stream is preferably^prgyideiT 
using the techniques described in the above-cited U.S. Patent Applica^ruAttOmey Docket No. 
Anand 1-16-15, any of a wide variety of well-known icori^entional channel coding techniques may 
be used in conjunction with the inventi^^suchasconvolutional or Turbo codes, cyclic redundancy 
check (CRC) codes, or cpmbinations of these and other codes. For example, rate compatible 
puncturing of cojivtflutional or Turbo codes may be used to provide unequal error protection for the 
progressiv€mt stream. Such channel coding techniques are known in the art and therefore not 



The above-noted experiments also indicated that if an error occurs in the most important 
portion of the bits in the progressive bit stream, i.e., approximately the first 60% of the bit stream, 
source decoding of this bit stream should be terminated and the rest of the bits in the bit stream 
should be discarded. In such situations, error detection is sufficient and error correction is not 
required. However, strong error detection capability is also required by these most important (-60%) 
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bits in the bit stream. Bit errors in the least significant portion of the progressive bit stream generally 
do not have a tremendous impact on output visual quality whether or not the bit errors are detected 
and corrected. Therefore, error detection alone may be used, or alternatively there may be no error 
protection provided for these least significant bits. The amount of channel error protection assigned 
to each bit can be chosen to maximize the expected PSNR given factors such as the total allowed 
redundancy, the channel SNR of the system, and the time permitted to transmit the remainder of the 



bi^ stream. 
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As mentioned previously, channel^orf>f^ suitable for use m conjunction 

with the presentjpv©ntil5i^^ in U.S. Patent Application Attorney Docket No. Anand 1- 

10 16^LS^^ 

A more detailed example of a type of communication system in which the present invention 
may be implemented will now be described with reference to FIGS. 3, 4 and 5. 

FIG. 3 shows a progressive coded video bit stream 300 generated by progressive video coder 
110 from a given group of frames 310. The group of frames may represent, e.g., a group of pictures 
3 1 5 (GOP) as the term is used in conventional video coding standards, or any other type of video signal 
u or image sequence. The bit stream 300 may be viewed as including a number of different portions, 

M with a maximum target bit rate of 384 kbps achieved when all portions are received, and 

^ intermediate bit rates of 64 kbps, 128 kbps and 256 kbps being achieved if only first, second or third 

iiij portions, respectively, are received. 

□ 20 FIG. 4 shows a heterogenous wired-to-wireless network communication system 400 in which 

the progressive coded video bit stream 300 of FIG. 3 may be utilized. The system 400 includes 
progressive video coder 110 and channel coder 112. The transmission medium 106 in this system 
includes a heterogeneous wired-to-wireless network connection through wired Internet 420 to abase 
station 422 of a wireless network. It should be understood that this is just one example of a 
25 heterogeneous network that may be utilized in conjunction with the invention. The term 
"heterogeneous network" as used herein is intended to include any type of network or other 
transmission medium having parts with different bandwidths, channel conditions or other capacity 
constraints. 
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A transcoder 424 processes the base station output for delivery via a wireless channel 426 
to a mobile receiver 1 04 ' . The mobile receiver 1 04 ' is assumed to include the channel decoder 114 
and video decoder 116 of FIG. 1 as well as additional signal processing elements. Although the 
transcoder 424 is shown as being after the base station 422 in this embodiment, in other 
5 embodiments it could be located before the base station 422, could be within the base station 422, 
or could be located elsewhere within the heterogeneous network. As will be described in greater 
detail below, the network element 424 is more generally referred to herein as a network element, and 
such an element may be implemented in a given embodiment without the use of transcoding 
, operations. 

Ho \> In operation, the progressive video bit stream 300 of FIG. 3 is generatedbj^he4>ro^essrve^ 

video coder 110. The channel coder 112 provides^grDgress^e^KaSnd protection for the 
progressive source coded bit stie§xr^TS^maxmev described in the above-cited U.S. Patent 
Application Attome^DodcetNo. Anand 1-16-15. The resulting channel coded output is delivered 
via transmission medium 106 to the mobile receiver 104' where it is processed to recover the 
1 5 opginal video stream. 
' : J The transcoder 424 is operative to process the progressive video bit stream as received from 

M the wired Internet 420 for transmission over the wireless channel 426 to the mobile receiver 104'. 

This processing is illustrated in FIG. 5. The bit stream 500 represents an encoded video bit stream 
^ as received from the wired Internet 420, and as shown includes a first portion 502, a second portion 

□ 20 504, and a third portion 506. The second portion 504 represents a portion of the stream that was not 
received at the transcoder 424 due to packet loss in the wired Internet. The first and third portions 
502 and 506, respectively, are received correctly. However, since the bit stream is a progressive bit 
stream, only the first portion 502 is sent over the wireless channel 426 to the mobile receiver 104'. 
The remaining portion 506, although correctly received, is nonetheless discarded rather than 
25 transmitted over the wireless channel 426. This is because the portion 506 is generally of little or 
no use in the decoding process, given the loss of portion 504, and therefore valuable bandwidth in 
the wireless channel 426 is conserved by discarding the portion 506. 

The progressive source coded bit stream provides the bit rate scalability that allows the bit 
stream to be adapted in an efficient manner for delivery over wireless channel 426 as described 
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above. For example, the portion 502 may be such that it permits transmission of a 128 kbps version 
of the video bit stream over the wireless channel 426, without requiring actual decoding and 
recoding of the received bit stream in the transcoder 424. The complexity of transcoder 424 is 
thereby considerably reduced. Although the network element 424 is labeled as a transcoder in this 
5 example, it should be understood that the present invention allows such an element to be 
implemented without the use of decoding or recoding operations. More particularly, network 
element 424 may be a general signal processing element implemented in a gateway or other network 
interface of the heterogeneous network, and need not provide any transcoding operations. 
Advantageously, the present invention provides bit rate scalability and adaptability without the need 
10 for transcoding operations. Of course, network element 424 may be implemented as an element 
which provides both transcoding for conventional non-progressive bit streams and bit rate scalability 
and adaptability for a progressive coded bit stream without transcoding using the techniques of the 
invention. 

The elements of the systems of FIGS. 1 and 4 are shown in simplified form for clarity of 
1 5 illustration. It should be understood that one or more of these elements may be implemented using 
processor-based devices such as microprocessors, digital signal processors (DSPs), application- 
specific integrated circuits (ASICs) as well as portions or combinations of these and other devices. 
The invention may be implemented in whole or in part in the form of one or more software programs 
stored and executed by such devices. Moreover, as previously noted, the FIGS. 1 and 4 systems may 
20 include additional elements not explicitly shown in the figures. 

The above-described embodiments of the invention are intended to be illustrative only. More 
particularly, the specific system elements and configurations described in conjunction with the 
illustrative embodiments are shown by way of example only, and numerous alternative system 
configurations are possible. In addition, the particular progressive coded video bit stream 
25 arrangements shown in FIGS. 2 and 3 are by way of example only, and alternative embodiments may 
use other scalability configurations. Furthermore, the invention can be implemented at least in part 
in one or more software programs stored in a memory of the network element 424 and executed by 
a processor thereof. These and numerous other embodiments within the scope of the following 
claims will be apparent to those skilled in the art. 
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Claims 



1. A method of processing a video signal for transmission over a heterogeneous network, 

the method comprising the step of: ^/^ 
5 coding the video signal in a progressive video coder so as to generate a progressive 

coded video bit stream, wherein the progressive coded video bit stream is configured to be decodable 



at any one of a series of increasing bit rates up to a maximum bit rate, depending on which of a 
number of corresponding portions of the progressive coded video bit stoeam are received by a 
decoder, and wherein each of the series of increasing bit rates pjefauce progressively better 
10 reconstructed video quality at an output of the decoder; 

transmitting the progressive coded video bit^ stream over a first part of the 

i *** 

3 heterogeneous network at a first one of the bit rates; and 

j;L; selectively transmitting one or more ofXne portions of the progressive coded video 

□ bit stream from the first part of the heterogeneous^network to a second part of the heterogeneous 
i= 3 .15 network, the one or more portions being associated with a second one of the bit rates lower than the 
* : ^ first bit rate, the one or more portions and the associated second bit rate being selected based at least 

u in part on one of more of: (i) an error detected in the transmission over the first part of the 

: ~l / 

!;= heterogeneous network; and (ii) a characteristic of the second part of the heterogeneous network. 

q 20 2. The method of claim 1 wherein the progressive coded video bit stream corresponds to a 

given group of frames of me video signal. 

3. The method of claim 1 wherein each of the corresponding portions is associated with a 
different bit rate 



4. /The method of claim 1 wherein each of at least a subset of the corresponding portions are 
associated with different frame rates. 
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5. The method of claim 1 wherein each of at least a subset of the corresponding portions are 

associated with different spatial resolutions. / 

/ 

/ 

6. The method of claim 1 wherein each of at least a subset of the correspondingfportions are 
5 associated with different signal-to-noise ratios. / 

7. The method of claim 1 wherein the particular portions of the progressive coded video bit 
stream which are received over the first part of the heterogenous network determine a 
corresponding amount of the bit stream that will be transmitted/over the second part of the 

1 0 heterogeneous network to the decoder for decoding at a particular :>ne of the series of increasing bit 
rates. / 

8. The method of claim 1 wherein the first pan of the heterogeneous network comprises a 
wired network connection and the second part of the heterogeneous network connection comprises 

15 a wireless network connection. / 

9. The method of claim 8 wherein the wired network connection comprises a wired Internet 
connection, and the wireless networloconnection comprises a wireless channel to a mobile receiver 
associated with the decoder. / 

20 / 

10. An apparatus fonise in processing a video signal, the video signal being coded so as to 
generate a progressive coded video bit stream, wherein the progressive coded video bit stream is 
configured to be decodable at any one of a series of increasing bit rates up to a maximum bit rate, 
depending on which/of a number of corresponding portions of the progressive coded video bit stream 

25 are received by /a decoder, and wherein each of the series of increasing bit rates produce 
progressively better reconstructed video quality at an output of the decoder, the progressive coded 
video bit stream being transmitted over a first part of the heterogeneous network at a first one of the 
bit rates, the apparatus comprising: 
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a network element coupled between the first part of the heterogeneous network and 
a second part of the heterogeneous network, the network element being operative to selectively 
transmit one or more of the portions of the progressive coded video bit stream from the first,part of 
the heterogeneous network to the second part of the heterogeneous network, the one or moreportions 
being associated with a second one of the bit rates lower than the first bit rate, the/one or more 
portions and the associated second bit rate being selected based at least in part on/One of more of: 
(i) an error detected in the transmission over the first part of the heterogeneouyfietwork; and (ii) a 
characteristic of the second part of the heterogeneous network. 



1 1 . The apparatus of claim 10 wherein the progressive coded^deo bit stream corresponds 
to a given group of frames of the video signal. 

12. The apparatus of claim 1 0 wherein each of the co^esponding portions is associated with 
a different bit rate. 

1 3 . The apparatus of claim 1 0 wherein eacly6f at least a subset of the corresponding portions 
are associated with different frame rates. 

14. The apparatus of claim 10 wherein each of at least a subset of the corresponding portions 
are associated with different spatial resolutions. 

1 5 . The apparatus of claym 1 0 wherein each of at least a subset of the corresponding portions 
are associated with different/signal-to-noise ratios. 



1 6. The apparatus of claim 1 0 wherein the particular portions of the progressive coded video 
bit stream which are received over the first part of the heterogeneous network determine a 
corresponding amount of the bit stream that will be transmitted over the second part of the 
heterogeneous/network to the decoder for decoding at a particular one of the series of increasing bit 
rates. 

15 
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1 7. The apparatus of claim 1 0 wherein the first part of the heterogeneous network comprises 
a wired network connection and the second part of the heterogeneous network comprises a wireless 
network connection. 

5 18. The apparatus of claim 17 wherein the wired network connection comprises a wired 

Internet connection, and the wireless network connection comprises a wireless channel to a mobile 
receiver associated with the decoder. 

1 9. An article of manufacture comprising a storage medium for storing one or more software 
10 programs for use in processing a video signal for transmission over ^heterogeneous network, the 
video signal being coded so as to generate a progressive coded video bit stream, wherein the 
progressive coded video bit stream is configured to be decodajjle at any one of a series of increasing 
bit rates up to a maximum bit rate, depending on which of i number of corresponding portions of 
the progressive coded video bit stream are received byX decoder, and wherein each of the series of 
1 5 increasing bit rates produce progressively better reconstructed video quality at an output of the 
decoder, the progressive coded video bit stream being transmitted over a first part of the 
heterogeneous network at a first one of th^/oit rates, wherein the one or more programs when 
executed implement the step of: 

selectively transmitting/6ne or more of the portions of the progressive coded video 
20 bit stream from the first part of the,Iieterogeneous network to a second part of the heterogeneous 
network, the one or more portions being associated with a second one of the bit rates lower than the 
first bit rate, the one or more portions and the associated second bit rate being selected based at least 
in part on one of more of>.(i) an error detected in the transmission over the first part of the 
heterogeneous networki/iind (ii) a characteristic of the second part of the heterogeneous network. 



20. A video transmission system comprising: 

a/progressive video coder operative to code a video signal so as to generate a 
progressive coded video bit stream, wherein the progressive coded video bit stream is configured 
to be decod able at any one of a series of increasing bit rates up to a maximum bit rate, depending 
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on which of a number of corresponding portions of the progressive coded video bit stream-are 
received by a decoder, and wherein each of the series of increasing bit rates prodxice-iSfo^essively 
better reconstructed video quality at an output of the decoder; 

a heterogeneous network comprising at least jpfifst part and a second part, the 
progressive coded video bit stream being transmitted ovepthe first part of the heterogeneous network 
at a first one of the bit rates; and 

a network element coupled>efween the first part of the heterogeneous network and 
the second part of the heterogeneous^fietwork, the network element being operative to selectively 
transmit one or more of the portions of the progressive coded video bit stream from the first part of 



1 0 the heterogeneous networlao the second part of the heterogeneous network, the one or more portions 
being associated with a second one of the bit rates lower than the first bit rate, the one or more 
portions and the'associated second bit rate being selected based at least in part on one of more of: 
(i) an errojxaetected in the transmission over the first part of the heterogeneous network; and (ii) a 
characteristic of the second part of the heterogeneous network. 
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Abstract 

A video signal is encoded in a progressive video coder so as to generate a progressive coded 
video bit stream for transmission over a heterogeneous network. The progressive coded video bit 
stream is configured so as to be decodable at any one of a series of increasing bit rates up to a 
5 maximum bit rate, depending on which of a number of corresponding portions of the progressive 
coded video bit stream are received by a decoder. Each of the portions is associated with a different 
bit rate, and one or more of the portions may each also be associated with different values of other 
parameters such as frame rate, spatial resolution, and peak signal-to-noise ratio. Each of the series 
of increasing bit rates produces progressively better reconstructed video quality at an output of the 

10 decoder. The progressive coded bit stream is transmitted over a first part of the heterogeneous 
network at a first one of the bit rates. One or more selected portions of the progressive coded video 
bit stream are then transmitted from the first part of the heterogeneous network to a second part of 
the heterogeneous network. The selected portions are associated with a second one of the bit rates 
lower than the first bit rate, and may be selected based on an error detected in the transmission over 

15 the first part of the heterogeneous network, and/or a characteristic of the second part of the 
heterogeneous network. The invention provides efficient bit rate scalability and adaptability and is 
particularly well-suited for use in conjunction with transmission over heterogeneous wired- to- 
wireless networks. 
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